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Abstract 

We derive a simple analytic expression for qq,gg —* tt — > bW + bW~ — * 
blv\bl'v~ii for on shell intermediate states with the interference effects due to 
the polarizations of the t and i. We then investigate how this effect may be 
measured at Tevatron or other hadronic colliders. 
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The experimental groups at Tevatron has already provided strong evidence for the top 
quark with mass around 174 GeV jlj]. In the near future, the data related to the production 
of the top quark is going to accumulate very quickly. Top quark decays very rapidly after 
its production. Therefore, it is challenging to investigate how one can determine the various 
detail properties of top quark in the complex hadronic collider environment. 

In this paper, we investigate an interesting physical consequence of the fact that the 
top quarks that are produced and decayed are supposed to be spin 1/2 particles. Due 
to the confinement phenomena of the strong interaction, the spin of a quark is in general 
very difficult to measure directly. Even if the quark is produced in a particular polarized 
state, the spin information is quickly averaged out by the hadronization process. One of the 
important effect of the polarizations of unstable particles are that the different polarized 
intermediate states can interfere. For lighter quarks, this effect may be smeared heavily 
by the hadronization process. However, in the case of the top quark, because of its mass, 
the decay rate is much faster than for the other quarks. The top quark decays before the 
hadronization effect has the time to smear its polarization information at production 0. 
This allows us to neglect the effect of hadronization. The same can not be said of any other 
quarks. Therefore, in this sense, this polarization effect also provide a unique possibility of 
direct observation of the spin of a quark. 

We use an analytic helicity technique developed in ref. £|] to calculate the cross section 
qq and gg — > ti — > bW + bW~ — > blv\bVv\_i. This cross section includes 6 particles in the 
final state. We derive simple analytic expressions including the interference effect, and then 
give the exact differential cross section assuming that the top quarks and the W bosons are 
on-shell. The decays of W bosons and top quarks are taken into account in the narrow width 
approximation. It is clear that the contribution due to the off-shell top quarks or the off-shell 
W bosons are negligible. The interference effects discussed here was also considered before in 
ref. [0] , however, it was studied only numerically and was done in a rougher approximation. 
The analytic expressions obtained here also allows us to make simple analysis about how 
such effect may be observable at Tevatron and future colliders. 
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To calculate the cross section using an analytic helicity technique, we split the process 
into many subprocesses that can be calculated independently. In our case, the polarization 
density matrix is split into two main sections and can be written as 

xP(t X3> rtx iK ^bbl + rv9). (1) 

Here the initial the final polarizations are summed over. N s is the number of initial states to 
be averaged over. N s = 4(N 2 — l) 2 for gg initial states; and N s = 4N 2 for qq initial states. 
n ? (r"j) = — i{rf — m 2 )~ l is the propagator for a scalar particle. Here, II t (ri) and Hf(r 2 ) 
represent the polarization independent components of the top quark propagators with the 
four-momenta r± and r 2 respectively. The helicity informations are included in the remaining 
density matrices. The polarization density matrix P is defined by 

P{ aij ...-►&«...) = M{ ai ...-►&*.. .)M\a 3 . . . -»■ k . . .) (2) 

with M being the amplitude for the process. When no subscript is included for a given 
particle with spin in P, it implies that its helicity is summed over. The polarization density 
matrix P(i\ 1 \ 1 i\ 2 x 2 — > ^a 3 a^a 4 a^) represents the production of the top quark pair via the 
processes qq — > ti or gg — > ti. They have been calculated analytically in detail in ref. [|J. 
-^ > (^a 3 a^a 4 a^ "~ * bbllvv) is the polarization density matrix for the decay of the top quark pair 
into b quarks and leptons. This density matrix can be further splitted into the product of the 
decay density matrix of ti into W + W~ bosons and bb pairs, and the decay density matrix 
of W + W~ boson pair into a pair of fermions each. The main advantage of this technique 
is that helicity density matrix of each subprocess can be calculated separately independent 
of each other. The results can then be applied to the calculation of different processes by 
gluing the density matrix of the subprocesses together. 

Therefore the polarized density matrix of the process t\ 3 \' 3 i\ 4 \> 4 — > bbllvv can be written 

as 
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P{tx 3 x>t XiK - bbl+l-vv) = Yl Pi^sK - W+jflPQ^ -> W- X ,b) \U w ( Pl )\ 2 

x \u w ( P2 )\ 2 p{w+ -> i + v)p{w- tiK -> ri/) (3) 



which can be explicitly calculated to be 



e*\V a \ 2 



xet M (A 5 )eiv(A / 5 )e;(r 1 )or a(A 3 A / ) , (4) 



xe^(A 6 )e 2 ,(A6)e;(r 2 )(T a{A4A1) , (5) 



\ sin "w ) 

and 



v sin # u / 

These results include summations over the helicities of the final state fermions. The four 
vectors hi, 1% and qi correspond to the momenta of the neutrinos, the charged leptons and 
the b quarks respectively. The subscript 1 is used to label the momenta related to the decay 
products of the top quark, while the subscript 2 is used for those related to the decay of 
the anti-top quark. ei A1 (As) represents the polarization vectors of W + with helicity A5, while 
e 2i/(Ae) represents those of the W~ with helicity \$. In our notation, the information about 
the top helicity is carried by the Pauli matrix a\ and o"o(— 1) with component (A3A3). For 
the anti-top, we used the conjugate matrix a a = 0"2<7 a 0"2 with component (A4A4). 

The tensor e a (rj), (a = 0, 1, 2, 3), were introduced in ref. H to evaluate the product of 
fermion wave functions, u(r, A)w(r, A'), in the amplitude squared for the cross section. They 
are defined as 

u(r, X)u(r, A') = ~(m + # (^(r)a 0(AV) + ^(r)j 5 a i(xy) ) , (8) 



v(r, X)v(r, A') = \(m-fi (f(r)a 0{xy) + ^(r) 7 5^(AAo) • (9) 

The explicit form of the tensor e a (rj) can be found in the reference but in our case, we 
only need the following properties, 

J2^e;(r) = m t 6 0a , (10) 

J2e^(r)el(r) = g ab , (11) 
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E ej(r)e£(r) = + V"/™?- ( 12 ) 



fc=i 



where r is the 4-momentum of either the top quark or the anti-top quark. The spatial 
component, e*(p) (i.e. i = 1,2,3), were first introduced by Bouchiat and Michel 0. 

One can then combine the above results for all the subprocesses and use the narrow 
width approximation for the W boson propagators to obtain 



P(h 3 x'h 4 x' -> bblluu) = 16m 2 ( | , f (Zi • e?)(fci ■ gi)(Z 2 ■ 4)(Afc ■ <? 2 K(a 3 a') ® ^&(a 4 a') 



2 sin 4 9. 



w , 

7i 2 5 {pi - m 2 w ) 5 (g| - m 2 w ) 

{M w v w y ■ {U) 

With this, one can then proceed to glue together the density matrix for the production, 
which has been given in Ref. Q, and those for the decays of the top quarks. For the top 
and anti-top propagators, we shall use also the narrow width approximation. These provide 
another two delta functions. After that, we can write the phase space for 6 final state 
particles in a such way that it will be straight forward to integrate out all the delta function. 
The phase space can be rewritten from the standard way [|J, 



d e (T -> k x l x q x k 2 l 2 q 2 ) = (2tt) 4 <5 4 (T - k x - l x - q x - k 2 - l 2 ~ 92) 

d 3 l\ d 3 ki d 3 qi d 3 l 2 d 3 k 2 d 3 q 2 
W?2E h (2vr)32£ fcl {2<Kf2E q , (2^2^ (27i)*2E k2 {2<Kf2E q2 



-d 2 (T -> r 1 r 2 )d 2 {r 1 -> piqi)d 2 (r 2 -> p 2 q 2 ) 



(14) 



(2vr) 4 

xd 2 (pi — > hk l )d 2 (p 2 — > l 2 k 2 )dr\dr 2 2 dp\dp\ (15) 
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where T M = V{ + i 2 , with % x and i 2 defined as the four-momenta of the initial partons and 



d 2 ( a ^bc) = (27r) 4 5 4 (a - b - c 



d 3 b 



d 3 c 



(16) 



(2n) 3 2E b (2tt) 3 2£, 

is the phase space for a particle with four-momentum a decaying into particles with four- 
momenta b and c. 

Combining the above results, we obtain directly the differential cross section 
P 



dot. 



4«i • i 2 



d 6 (T ->■ k x l x q x k 2 l 2 q 2 ) 



An 2 at ( e 4 \V f 



|2 \ 2 



tb\ 



X 



N \2 sin # w / • «2 

d 2 (ri -> Piqi)d 2 (r 2 -> p 2 q 2 )d 2 {pi -> hhjd^ -> / 2 /c 2 ) 



(17) 



(M^rvM t r t ) z 

iV is the number of color and the indices m designate the initial particles. We have the result 
for the — > tt case 



99 



rr — 1 



1 



iV 2 



2r°r 2 3 



— + - 1 

a; 7^ V 



a; 

2f 



+ 1 



2 7 2 



1 



+ 4 7 2 I, 1 2 7 2 , 
and for the gg — * ££ case 

<?<? 



U - t 



R a T (] _ T a R p 



(18) 



2N 



2r^r{ 



1 



2 7 2 
1 



1 _x_ 
~ X \ ~ 2^2 



4 7 2 



2 \9 



a/3 



(r?7* + T°r?)- ^ ^ ^ 



(19) 



The s, £ and u are the Mandelstam variable, T^ 1 = + i 2 , = i± — i 2 , 7 2 = s/Am 2 and 
x = s 2 /2(t - m 2 )(u - m 2 t ). 

We want to show the spin effect of the quark. We need to compare to the case where the 
top quark is taken to be a spinless particle. This will allow us to pinpoint the spin effect. 
One way to get formula for the spinless case is to take the average of the top quark helicity 



6 



both in the production density matrix and in the decay density matrix independently before 
we join them together. In the usual Monte Carlo simulation for the experiments, this is 
indeed the approximation taken by the program. The cross section can be obtained by 
substituting I gg and I qq with 



jaj3 
99 



X — 1 — 



N 2 - 1 



1 1 

x 7 Z 



1 - 



x 

2^f 



(20) 



and 



9Q 



'N 2 ~r 



r r 



, 2N J I 1 2 \~ x\~ 2 7 2 / J J ' 
For the last two equation, we should emphasize that the cross section without the spin 
correlation for the top quark is the one that has been used in the literature and by most of 
the experimental event simulators. 

If one does not observe any correlation between the observables associated with the final 
decay products of top decays, the differential cross sections can be integrated easily in a 
covariant notation using well known relation for integration of two particles phase-space. 
One can obtain a very simple expression for the differential cross section 



1 - 



1 



1 - 



x 



(21) 



e 4 \V t 



tb\ 



dcos9 9 x 2 19 tt 3 N \ 2 sin 4 0„ 



Mi 



w 



T w T t m t 



1/2 



1 - 



r 



X(l,y b ,y w ) 



x 



1+yb- 2y w + 



3 - yjl 

yw 



(22) 



where 9 is the angle between the incoming parton i 1 and the top quark r±, = ml/m 2 , 
y w = m 2 v /m 2 and A(a, b, c) = a 2 + b 2 + c 2 — 2ab — lac — 2bc. The integration over one of the 
top branch gives result proportional to rfl a p or r^Iap- As expected, after the integration of 
final phase space variables, spinless approximation gives the same result as the exact one. 
This can be seen as a consequence of the identities 



r Ta/3 _ ja/3 ja/3 _ ja/3 

Tla-lgg -ria-lgg, T^l gg ~ ^lgg 



(23) 



and 



r ja/3 — r T a P r ja/3 _ ja(3 



(24) 



The result not only confirms that the interference effects indeed vanish when integrated over 
the complete phase space, but also, that if one integrates over all the phase space variables 
associated to the decay products of just one of the top quarks, the spin interference effect 
will disappear. Equivalently if we measure any observables related to only one of the top (or 
anti-top) quark, the effect will not show up. Therefore, to measure interference effect, we 
need to find observables that correlate the kinematic variables associated with the particles 
from the top quark decay and those from the anti-top quark decay. Intuitively, it is not 
obvious what is the best correlated observable which can probe this interference effect. For 
the rest of this paper, we shall present our attempts in this direction. 

Before we discuss how to probe the interference effect, one should note that Eq.(p2|) 
can be further simplified. The widths can be replaced by branching ratios using T t = 
Ft->Wb/ 'Br(t — > Wb) and Y w = T w ^j v J Br(W — > lv{). The partial widths can be calculated 
trivially at tree level, and the branching ratios can be evaluated by summing over all the 
possible channels for top desintegration. The cosO integration can also be performed to 
reproduce the well-known result || 

and 



a 99 = tt^P 



( 66 _ 36/3 2 + 2/3 4 ) ± In (i±|) - 59 + 31/3 



(26) 



48s' 

where f3 2 = 1 — I/7 2 . 

To probe the interference effect, we shall look for observables related to the final decay 
products, instead of using directly the top momenta which need to be reconstructed. The 
easiest observables to try are those related to the two charged leptons (electron or muon) from 
the leptonic decays of two Ws. The advantage is that these particles can be easily observed 
in a hadron collider. On the other hand, the dilepton decays has lower branching ratios, 
which reduces the statistics. For this case, we have investigated the effect of interference on 
the distribution of (1) their total energy E\ x + Ei 2 , (2) their total z-momentum l\ z + l 2z , (3) 
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an orthogonal combination l lz — l 2z , (4) the cosine of the angle between these two charged 
leptons and (5) the asymmetries A p and A ± to be defined later. To get these distributions 
as a function of the observables, the numerical integration program (VEGAS) is used. The 
top quark mass is taken to be m t = 176 GeV in all numerical analyses. 

In Fig. 1, we show the differential cross section da/dvi for the quark- ant iquark collision 
where vi = (E h + E h )/y/s. We show curves a, b, c, d and e for y/s = 400,500,700, 1000 
and 2000 GeV. At each energy, we plot the cross section with (without) interference effect 
with solid (dash) lines. We found that, for the quark- ant iquark collision, in the central 
(peak) region the interference effect decreases the cross section while at the two shoulders, 
it enhances the cross section. In addition, while the overall cross section decreases roughly 
as 1/s as s increases, the percentage decrease of the maximum value of dajdv\ due to the 
interference effect actually increases as s. (For example, for y/s = 400 GeV, the peak of the 
cross section decreases from 1.17 pb to 1.15 pb, while, for y/s = 1 TeV, it decreases from .19 
pb to .17 pb.) In other words, comparing to the spinless case, the effect of the interference 
gets stronger as the total energy increases. 

In Fig. 2.1 and 2. II, we show the same differential cross section da/dvi for the gluon 
fusion case. Again, we plot the cross section with (without) interference effect using solid 
(dash) lines. In Fig. 2.1, we use y/s = 400, 500 GeV for curves a, b and, in Fig. 2. II, we 
use y/s = 700, 1000 and 2000 GeV for curves c, d and e respectively. For y/s < 700 GeV, 
unlike the previous case, the cross section increases with s as is well-known. And here, also 
in stark contrast with the previous case, the effect of the interference increases the values of 
the cross section in the region near the peak, while making the values at the two shoulders 
decrease. However, for higher total energy y/s, the behavior become the same as the case 
for qq. One should also note that the interference effects for gluon fusion case appear to be 
always smaller than that for the quark-antiquark production process. 

In Fig. 3 and Fig. 4, we show distribution of da/dv 2 as a function of v 2 = (If + iQ/y/s 
for quark-antiquark (qq) production and for gluon fusion (gg) production respectively. The 
l\ is the ^-component of the momentum, l ± , of the lepton from top decay where the z is 
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defined to be the direction of parton i\ which is also the beam axis. Similarly, one defines 
l\ with the same definition of z-axis. The curves a, b, c and d in Fig. 3 for qq case 
correspond to y/s = 400, 500, 700 and 1000 GeV while, in Fig. 4 for gg case, the curves 
a, b and c correspond to y/s = 400,450 and 500 GeV. In qq case, the interference effect 
always increases the peak of the distribution. In addition, the percentage increase of the 
effect decreases with y/s but only mildly. For gluon fusion case, below y/s = 700 GeV, the 
peak of the distribution is reduced by the interference effect and then become larger for y/s 
over 1 TeV. However, the effect is smaller than the qq case in general. 

We have also analyzed the effect of the interference on the distribution of da/dv^ as a 
function of v 3 = (If — l%)/y/s. We found the interference effect to be negligibly small at y/s 
below 700 GeV for qq production. The effect is even smaller for all the other y/s and for the 
case of gg production. 

A potentially very interesting way to observe the interference effect is to measure the 
distribution of angle between the two final leptons. We get a good signal of the interference 
effect near the threshold of the tt production. For qq production, we plot in Fig. 5. II, the 
differential cross section da /d cos a as a function of cos On. The curves a, b and c correspond 
to y/s = 400, 500 and 700 GeV and On is the angle between the two lepton. For comparison, 
we plot in Fig. 5.1, the differential cross section da/dcosOww as a function of cos Qww for 
the same y/s, where &ww is the angle between the two W bosons. Somewhat unexpectedly, 
we found that the signal of interference is much stronger in da / d cos On than that in the case 
of da/dcosOww- This difference seems to indicate that at the level of W + W~ in addition 
to the asymmetry carried by the the kinematic variable cosOww, some asymmetry due to 
the interference is carried by the helicity information of the W bosons. This helicity-related 
asymmetry is turned into the leptonic angular asymmetry as W bosons decay. As a result, 
the angular asymmetry for the angle between the leptons provides more sensitive signal than 
the angular asymmetry for the angle between the W bosons. We can see that both side of 
the distribution for leptons case change by more then 25 % . For increasing y/s up to 1 TeV, 
the qq collision still show a large difference between the cross sections with and without the 
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interference effect. 

For the gluon fusion, we also produce the distributions da / dcosOww an d da/dcosOu, as 
shown in Fig. 6.1 and Fig. 6. II. The curves a, b and c correspond to y/s = 400,450 and 500 
GeV. At y/s = 400, the two distributions for da/dcos6u differ dramatically from each other 
up to a factor 2. However, the difference is reduced quickly as y/s increases, the difference is 
negligible at y/s = 700 GeV. The most important characteristic is that, in contrast with Fig. 
1-4, the signal does not just consist of a change in the width or height, but a change in the 
shape of whole distribution and therefore may provide an easier signature for experiments. 

The other interesting observables are the following two new kinds of asymmetries. In 
these asymmetries, one looks at the directions of momenta of two particles and compares if 
they are on the same side of a defining plane or on the opposite side. The asymmetry can 
be defined as A = (iV samc - iV p positc )/ (N same + iV op p 0sitc ). For the first asymmetry, the plane 
is the production plane defined by the beam axis and the direction of the top quark. The 
two incoming partons and the two top quarks lie on this plane. The asymmetry associated 
with this plane will be called A p . For the second asymmetry, the defining plane is to be the 
one that is perpendicular to the beam axis. The associated asymmetry will be called A±. 

In Fig. 7a, we show A p as a function of y/s using the momenta of the two final leptons 
to define asymmetry. As a comparison, in Fig. 7b, we show the same asymmetry but now 
using the momenta of the two W bosons as the defining directions. The solid lines are for 
the case of qq production. The dotted lines are for gluon fusion. The asymmetry should 
vanish without the interference effect. Note that just as the earlier cases, the asymmetry 
is more pronounced when measured by the final leptons, instead of by the intermediate, 
polarized W bosons. As shown in Fig. 7a, the asymmetry, A p , can be as large as 5-10 
percent. Experimentally it is also important to note that this asymmetry is invariant under 
a boost in the beam direction. Therefore, as long as the transverse momenta of the initial 
partons are small, the asymmetry is more or less insensitive to the longitudinal momenta of 
the initial partons. 

In Fig. 8, we show A± as a function of y/s. Here we present only the result for the case 
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in which the momenta of the two final leptons are used to define asymmetry. Just as the 
previous case, if the W momenta are used instead of the lepton momenta, the asymmetry is 
smaller. The solid line is for qq production including the interference effect. The dash line is 
for qq production without the interference effect. The dotted line is for gg fusion including 
the interference effect. The dash-dot line is for gg fusion without the interference effect. As 
shown in the figure, the asymmetries in all these channels are all negative with sizes of order 
.4-. 7. Unfortunately, this asymmetry is sensitive to whether the initial partons are colliding 
in their center of mass in the Lab. frame or not. Therefore, it is probably harder to isolate 
the effect from the background. 

In conclusion, we have obtained an analytic formula for the cross section of the top quark 
pair production and their decays into b quarks and W bosons which, in turns, decay into two 
fermions. Our result includes the interference effect due to the fact that top quarks carry 
spin and therefore the intermediate states have more than one spin channels. A measurement 
of this interference effect can be seen as the direct measurement of the spin effect of the 
top quarks. To demonstrate the use of these analytic results, we use them to search for 
observables that may provide a good measurement of the interference effect. While none of 
the observables may be straightforward to measure, we show that appreciable effects might 
be observable in the asymmetries defined by the relative angular distributions of the leptons 
coming from both W bosons. More realistic simulation needs to be carried out before these 
potential observables can prove to be useful experimentally. 
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FIGURES 



Fig. I. The differential cross section da/dv 1 with (without) interference effect using 
solid (dash) lines for the quark- ant iquark collision. The curves a, b, c, d and e correspond 
to^ = 400, 500, 700, 1000 and 2000 GeV. 

Fig. 2. Same as Fig. 1 but for the gluon fusion. 

Fig. 3. The differential cross section da/dv 2 with (without) interference effect using 
solid (dash) lines for the quark-antiquark collision. The curves a, b, c and d correspond to 
y/s = 400, 500, 700 and 1000 GeV. 

Fig. 4. The differential cross section da/dv 2 with (without) interference effect using solid 
(dash) lines for the gluon fusion. The curves a, b and c correspond to y/s = 400, 450 and 
500 GeV. 

Fig. 5. The differential cross section (I) da/dcos6 ww and (II) da/dcos9 u with (without) 
interference effect using solid (dash) lines for the quark-antiquark collision. The curves a, b 
and c correspond to yfs = 400, 500 and 700 GeV. 

Fig. 6. The differential cross section (I) do jd cos 6 ww and (II) da / d cos 6u with (without) 
interference effect using solid (dash) lines for the gluon fusion. The curves a, b and c 
correspond to y/s — 400, 450 and 500 GeV. 

Fig. 7. The asymmetry A p using (a) the two final leptons and (b) the momenta of 
the two W bosons to define directions The solid (dash) lines correspond to the case of qq 
production (gluon fusion). 

Fig. 8. The asymmetry Aj_ as a function of y/s. The solid (dash) line is for qq produc- 
tion including (without) the interference effect. The dotted (dash-dot) line is for gg fusion 
including (without) the interference effect. 
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